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Image Processing 

Field of the Invention 

[0001] The present invention relates to a network system for image data 
5 processing systems, in which a network configuration file on each computer 
is automatically updated whenever changes are made to the network. 

Background of the Invention 

[0002] Networks for image data processing systems are known that use 
10 standard distribution protocols, such as Ethernet, TCP/IP and HiPPI. In video 
facilities houses, a recent trend has been towards having a plurality of 
different image processing stations therefore it has been appreciated that 
highly powered stations, having relatively high hourly charges, may be used 
for specific operations where a high degree of processing power is required. 
15 However, overall charges may be reduced by performing less demanding 
tasks at more modest stations. Matching the level of the task to the level of 
the station rather than to the location at which the image data needs to be 
stored requires methods for transferring that data as quickly as possible. 

20 [0003] Co-pending British patent application 00 08 318.8, 2034-P565- 
GB and 2034-P564-GB describe methods of using a high bandwidth fibre 
channel switch, connected to a plurality of image processing stations and a 
plurality of redundant arrays of inexpensive disks (RAIDs), to convey image 
data over a high bandwidth channel without the cost of setting up a high 

25 bandwidth network. This is achieved either by requesting access to data 
stored in a RAID controlled by another station or by actually taking control of 
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a RAID currently controlled by another station. 

[0004] In this situation it is necessary that at all times every image 
processing station within the network is aware of exactly which stations are 
5 online and which RAIDs they are connected to, so that if a particular image 
processing station needs data from a particular RAID it has up-to-date 
information about which station presently controls that RAID and whether the 
data is currently available. 

10 [0005] It is known to include within a processor a configuration file which 
contains information about the way in which the network is set up and which 
connections have been made, but at present these configuration files must 
be manually updated by a user when a change to the network takes place. It 
is also known for a computer coming online within a network to announce 

15 itself to all connected machines but still the configuration file must be updated 
manually. 

[0006] This updating process often necessitates closing down all 
currently running applications, which is inconvenient and not always 
20 immediately possible, and so the configuration file on a particular processing 
system may remain incorrect for a period of time. Also, manual updating of a 
configuration file inevitably results in mistakes, especially when the user is 
unfamiliar or uncomfortable with the technology. Thus a system administrator 
must often be employed to be in charge of this updating. 



25 



2034-P561-US 



3 

network configuration updated and send it to other machines on request 
However, when machines are connected to various different networks, each 
using a different protocol, as is often the case, every machine within a 
network could require different information. In addition, a system 
5 administrator would again be necessary. 

Brief Summary of the Invention 

[0008] Image data processing apparatus, comprising a plurality of image 
processing systems in which each of said image processing systems has 

10 direct access to a respective frame storage means; and a network 
connecting said image processing systems together so as to allow each 
connected image processing system to indirectly access the frame storage 
means of the other connected image processing systems; wherein each 
image processing system includes a local configuration file specifying details 

15 of its respective locally connected storage means, a network configuration 
data structure, and network communication means; wherein said network 
communication means is arranged to transmit details of its associated 
configuration file to other networked image systems, and to add configuration 
data to its associated network configuration data structure in response to 

20 configuration details received from other networked image processing 
systems. 

Brief Description of the Several Views of the Drawings 
[0009] Figure 1 shows an networked image data processing 
25 environment; 
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[0010] Figure 2 illustrates an image processing system of the type 
shown in Figure 7; 

[001 1] Figure 3 illustrates a processor of the type shown in Figure 2; 

[0012] Figure 4 illustrates image frames of the type processed by the 
5 system shown in Figure 7; 

[0013] Figure 5 illustrates a redundant array of inexpensive disks 

accessed by a fibre channel interface; 
^ [0014] Figure 6 shows an example of a local configuration file on the 

% hard drive of a processing system; 

;Ji 10 [0015] Figure 7 shows an example of a network configuration file in the 
*Jjj memory of a processing systems; 

^ [0016] Figure 8 shows the first set of communications embodying the 

invention; 

y [0017] Figure 9 shows the second set of communications embodying 

15 the invention; 

[0018] Figure 10 illustrates the primary thread shown in Figure 8; 
[0019] Figure 11 details steps carried out in Figure 10 to write the 
network configuration file; 

[0020] Figure 12 details steps carried out in Figure 11 to determine the 
20 best interface for communication; 

[0021] Figure 13 shows the functions carried out by the primary thread 
to update the network configuration file; 

[0022] Figure 14 illustrates the information-adding function shown in 
Figure 73; 

25 [0023] Figure 75 details steps carried out in Figure 14 to delete incorrect 
information from the network configuration file; 
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[0024] Figure 16 illustrates the information-deleting function shown in 
Figure 13] 

[0025] Figure 17 illustrates the communications check responding 
function shown in Figure 13] 
5 [0026] Figure 18 illustrates the information-supplying function shown in 
Figure 13] 

[0027] Figure 19 details the termination of the primary thread; 
^ [0028] Figure 20 shows the functions carried out by the maintenance 

% thread; 

|S 10 [0029] Figure 21 illustrates the communications check function as 
;1! shown in Figure 20] 

y [0030] Figure 22 details steps carried out in Figure 21 to determine 

y addresses to be checked; 

¥ [0031] Figure 23 illustrates the swap update function as shown in Figure 

g 15 20] 

[0032] Figure 24 details steps carried out in Figure 23 to rewrite the 
network configuration file; and 

[0033] Figure 25 illustrates the manual change update function as 
shown in Figure 20, 

20 

Best Mode for Carrying Out the Invention 
Figure 1 

[0034] An example of a networked image data processing environment 
is illustrated in Figure 1. The network includes eight image data processing 
25 systems 101, 102, 103, 104, 105, 106, 107 and 108. Each processing 
system 101 to 108 has a respective frame storage disk array (hereafter 
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referred to as a framestore) 111, 112, 113, 114, 115, 116, 117 and 118. For 
example, each framestore 111 to 118 may be of the type obtainable from the 
present Assignee under the trademark "STONE" providing sixteen disks each 
having nine G-bytes of storage. Initially, each of the framestores is operated 
5 under the direct control of its respective processing system. Thus, framestore 
111 is operated under the direct control of image data processing system 101 
and framestore 113 is operated under the direct control of off-line processing 
system 103, but processing systems may swap control of their respective 
framestores for an unlimited period of time. 

10 

[0035] The environment includes a sixteen port non-blocking fibre 
channel switch type 121, such as the type made available under the 
trademark "GADZOOX". The switch is employed within the data processing 
environment to allow fast full bandwidth accessibility between each host 
15 processor 101 to 108 and each framestore 111 to 118, Each data processing 
system 101 to 108 is connected to the fibre channel switch by a respective 
fibre cable 131 to 138. Similarly, each framestore is connected to the fibre 
channel switch via a respective fibre cable 141 to 148. 

20 [0036] An Ethernet network 151 allows communication between the 
data processing systems 101 to 108 and the fibre channel switch 121. In 
addition a high-bandwidth HiPPI network 152 connects processing systems 
101, 102 and 103, but not processing systems 104 to 108. This mirrors 
existing operational environments, in which a processing system would be 

25 connected to a number of different networks, but not all systems would be 
connected to all networks. Hence, in this embodiment, processing systems 
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101 to 103 can communicate via a high-bandwidth network and the Ethernet, 
but processing systems 104 to 108 can only communicate via the Ethernet. 

[0037] Within the environment, a single processing system, such as 
5 system 101, is selected as fibre channel switch master. Under these 
conditions, it is not necessary for all of the processing systems to be 
operational but the master system 101 must be online before communication 
can take place through the switch. However, in most operational 
environments, all of the processing systems would remain operational unless 
10 taken off-line for maintenance or upgrade etc. Processing system 101 
communicates with the fibre channel switch 121 over the Ethernet network 
151. Commands issued by processing system 101 to the fibre channel switch 
define physical switch connections between processing systems 101 to 108 
and framestores 111 to 118. 

15 

[0038] On start-up, the fibre channel interface 121 is placed in the same 
condition that it was in when it was switched off. On the first start-up the 
switch would be placed in the default condition to the effect that each 
processor is connected through the switch 121 to its respective framestore. 
20 Thus, on first booting up processing system 101, for example, it mounts 
framestore 111, but if when processing system 101 was shut down it 
controlled framestore 117 it would mount framestore 117 again on booting 
up. 

25 [0039] Thus each processing system is host to a particular framestore, 
which may or may not be the one which it originally controlled when the 
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network was set up. Another processing system may only gain access to a 
framestore if it is allowed to do so by the processing system currently 
controlling that framestore. This access could be through fibre channel switch 
121 or, in the case of processing systems 101 to 103, through the high- 
5 bandwidth HiPPI network 152. 

[0040] For instance, if one of processing systems 104 to 108 requires 
fast access to any framestore, this must be achieved via fibre channel switch 
121. If one of processing systems 101 to 103 requires access to a framestore 
10 controlled by one of processing systems 104 to 108, then again fast access 
can only be obtained via the fibre channel switch. However, if one of 
processing systems 101 to 103 requires access to a framestore controlled by 
another of 101 to 103, then the HiPPI network is as fast as the fibre channel 
switch and so either could be used. 

15 

[0041] In all cases the Ethernet could theoretically be used, but it is very 
slow and there are no compensating advantages, so in practice data is 
transferred either through the fibre channel switch or through the fastest 
network supported by both processing systems. 

20 

[0042] Hence when a network other than the Ethernet is available to a 
processing system, it is necessary that the processing system is aware of 
which other processing systems are connected to it and which are not. The 
invention ensures that this happens. 



25 
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Figure 2 

[0043] An image data processing system, such as processing system 
101, is illustrated in Figure 2, based around an octane processor 201. 
Program instructions executable within the octane processor 201 may be 
5 supplied to said processor via a data carrying medium, such as a CD ROM 
202. 

[0044] Image data may be loaded locally and recorded locally via a local 
digital video tape recorder 203 but preferably the transferring of data of this 
10 type is performed off-line, using stations 103 to 108. 

[0045] An on-line editor is provided with a visual display unit 204 and a 
high quality broadcast quality monitor 205. Input commands are generated 
via a stylus 206 applied to a touch table 207 and may also be generated via a 
15 keyboard 208. 

Figure 3 

[0046] Processor 201 as shown in Figure 2 is detailed in Figure 3. The 
processing system 201 comprises two central processing units 301 and 302, 

20 operating in parallel. Each of these CPUs 301 and 302 has a dedicated 
secondary cache memory 311 and 312 that facilitates per-CPU storage of 
frequently used instructions and data. Each CPU 301 and 302 further 
includes separate primary instruction and data cache memory circuits on the 
same chip, thereby facilitating a further level of processing improvement. A 

25 memory controller 321 provides a common connection between the CPUs 
301 and 302 and a main memory 322. The main memory 322 comprises two 



10 

gigabytes of dynamic RAM. 

[0047] The memory controller 321 further facilitates connectivity 
between the aforementioned components of the processor 201 and a high 
bandwidth non-blocking crossbar switch 323. The switch makes it possible to 
provide a direct high capacity connection between any of several attached 
circuits, including a graphics card 324. The graphics card 324 generally 
receives instructions from the CPUs 301 and 302 to perform various types of 
graphical image rendering processes, resulting in images, clips and scenes 
being rendered in real time. 

[0048] A SCSI bridge 325 facilitates connection between the crossbar 
switch 323 and a DVD/CD ROM drive 326. The DVD drive provides a 
convenient way of receiving large quantities of instructions and data, and is 
typically used to install instructions for the processor 201 onto a hard disk 
drive 327. Once installed, instructions located on the hard disk drive 327 may 
be transferred into main memory 322 and then executed by the CPUs 301 
and 302. An input output (I/O) bridge 328 provides an interface for the 
graphics tablet 207 and the keyboard 208, through which the user is able to 
provide instructions to the processor 201 . 

[0049] A second SCSI bridge 329 facilitates connection between the 
crossbar switch 323 and network communication interfaces. Ethernet 
interface 330 is connected to the Ethernet network 151 and first high 
bandwidth interface 331 is connected to the fibre channel switch 121 by 
connection 131. Second high bandwidth interface 332 is connected to the 
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HiPPI network 152, but only on processing systems 101 to 103. Hence the 
processors of processing systems 104 to 108 are identical to the processor 
shown in Figure 3 except that they do not have the second high bandwidth 
interface 332 since they are not connected to the HiPPI network 152. 

5 

[0050] Stored on the hard drive 327 is local configuration data 341 
which contains information about the local connections of system 102, 
including which framestore it currently controls and what network interfaces it 
supports. On starting the processor local configuration data 341 is loaded into 

10 main memory 322 as file 342. Communications with each of processing 
systems 101 and 103 to 108 that are connected to the Ethernet result in a 
network configuration file 343 being written in memory 322. This contains 
connection information about all on-line processing systems, including 
system 102, and gives, for each framestore, the Ethernet address of the 

1 5 system which controls it and the best interface for communication. 

[0051] For instance, this figure shows the processor of processing 
system 101, which is connected to the HiPPI network. The best way for 101 
to communicate with processing systems 102 or 103 is via the HiPPI 
20 network, but for communication with processing systems 104 to 108 it would 
be the Ethernet. Hence, in network configuration file 343, a HiPPI address 
would be given for processing systems 102 and 103, and an Ethernet 
address for each of processing systems 104 to 108. 

25 [0052] Local configuration data 341 must be manually written when the 
processing system is first connected to the network, but is automatically 
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updated by the invention if a framestore swap occurs. It must be manually 
updated if the interfaces of the processing system change, but this should 
only occur if a system is physically unplugged from its present connections. 
This is envisaged to happen very infrequently and such disconnection would 
5 only be performed by a person knowledgeable enough to update the 
interface information. In addition, the information would still only have to be 
changed in the local configuration data 341 of the affected system. The 
invention would ensure that all other processing systems on the network 
were aware of the interface change. 

10 

Figure 4 

[0053] A plurality of video image frames 401, 402, 403, 404 and 405 are 
illustrated in Figure 4. Each frame in the clip has a unique frame identification 
(frame ID) such that, in a system containing many clips, each frame may be 

15 uniquely identified. In a system operating with standard broadcast quality 
images, each frame consumes approximately one megabyte of data. Thus, 
by conventional computing standards, frames are relatively large. Therefore 
even on a relatively large disk array the total number of frames that may be 
stored is ultimately limited. An advantage of this situation, however, is that it 

20 is not necessary to establish a sophisticated directory system thereby 
assisting in terms of frame identification and access. 

[0054] As a processor, for example processor 101, boots up, it mounts 
its associated framestore. Stored on the hard drive of processor 101 is 
25 location data which describes the frames that are available within the 
framestore and in particular maps frame IDs to physical storage locations 
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within the disk system. Thus, as illustrated in Figure 4, the frame with ID 
561000001 is stored at location 040000, the frame with ID 561000002 is at 
location 040001 , and so on. Thus if an application identifies a particular frame 
it is possible for the system to convert this to a physical location within the 
5 framestore. 

Figure 5 

[0055] A framestore, such as framestore 111, is illustrated in Figure 5. 
The framestore 111, connected to the fibre channel switch by fibre cable 141, 
10 includes six physical hard disk drives, illustrated diagrammatically as drives 
510, 511, 512, 513 and 514. In addition to these five disks configured to 
receive image data, a sixth redundant disk 515 is provided. 

[0056] An image field 517, stored in a buffer within memory, is divided 
15 into five stripes identified as stripe zero, stripe one, stripe two, stripe three 
and stripe four. The addressing of data from these stripes occurs using 
similar address values with multiples of an off-set value applied to each 
individual stripe. Thus, while data is being read from stripe zero, similar 
address values read data from stripe one but with a unity off-set. Similarly, 
20 the same address values are used to read data from stripe two with a two 
unit off-set, with stripe three having a three unit off-set and stripe four having 
a four unit off-set. In a system having many storage devices of this type and 
with data being transferred between storage devices, a similar striping off-set 
is used on each system. 

25 
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[0057] As similar data locations are being addressed within each stripe, 
the resulting data read from the stripes is XORd together by process 518, 
resulting in redundant parity data being written to the sixth drive 515. Thus, 
as is well known in the art, if any of disk drives 510 to 514 should fail it is 
possible to reconstitute the missing data by performing a XOR operation 
upon the remaining data. Thus, in the configuration shown in Figure 5, it is 
possible for a damaged disk to be removed, replaced by a new disk and the 
missing data to be re-established by the XORing process. Such a procedure 
for the reconstitution of data in this way is usually referred to as disk healing. 

[0058] Each of these framestores shown in Figure 5 is controlled by only 
one of processing systems 101 to 108. The system which controls a 
framestore may access it at will, but a processing system may need images 
stored on a framestore which it does not control. Hence in the network 
environment shown in Figure 1 it is possible for a processing system, such as 
processing system 102, to gain either temporary or permanent access to a 
framestore connected to another processing system, such as framestore 
113. 

[0059] For example, if processing system 1 02 is performing a task which 
mainly uses images stored in its own framestore 112 but also requires some 
frames from framestore 113 then processing system 102 issues requests for 
these frames to processing system 103, which controls framestore 113. 

[0060] If processing system 103 is able to allow access to framestore 
113 then access can be achieved in one of two ways. Firstly, processing 
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system 103 can return the locations of the requested frames to processing 
system 102 over Ethernet 151. It then requests a daemon running on 
processing system 101 to connect processing system 102 with framestore 
113 via fibre channel interface 121 for a short period of time. The second 
method involves processing system 103 copying the required frames and 
sending them, via the fastest network supported by both processing systems, 
to processing system 102. In this case it would be the HiPPI network 152. 

[0061] Alternatively, if a more permanent connection is required, 
processing systems may swap framestores. For example, while processing 
system 102 is performing a task processing system 103 may be loading data 
necessary for the next task for processing system 102. When processing 
system 102 completes the current task it swaps framestores with processing 
system 103 and has immediate access to the frames necessary for its next 
task. Processing system 103 may now archive the results of the task which 
processing system 102 has just completed. 

[0062] Any of processing systems 101 to 108 may initiate this swap by 
requesting the switch-controlling daemon on processing system 101 to 
connect processing system 102 with framestore 113 and processing system 
103 with framestore 112 via fibre channel interface 121. Each processing 
system mounts its new framestore and has complete control of it. For 
example, any processing system, including processing system 102, wishing 
to access framestore 112 must now request this access from processing 
system 103. 
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[0063] When this swap has occurred all other processing systems 101 
and 104 to 108 must be informed, because if, for example, processing 
system 108 requires access to framestore 112, it now has to request it from 
processing system 103, where previously it had to contact processing system 
102. 

[0064] The present system involves manual updating of a configuration 
file stored on each of data processing systems 101 to 108, but the invention 
enables the updating to be performed by threads running on each of 
processing systems 101 to 108. 

[0065] The local configuration of a processing system must be manually 
entered on its own hard drive when it is first connected to the network. As 
shown in Figure 3, all processing systems contain local configuration data 
341 on the hard drive 327, which only contains information about the local 
connections. This data is parsed and read into memory as file 342 when 
processing system 101 starts up. 

Figure 6 

[0066] Figure 6 gives an example of such a file residing on processing 
system 101, although those on the hard drives of processing systems 102 to 
108 are similar. Line 601 gives the information relating to framestore 111, the 
framestore which processing system 101 currently controls. (If, for example, 
processing system 101 had swapped with processing system 103 and now 
controlled framestore 113, then it would be framestore 113's details which 
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would appear at line 601.) 'Brazil' is the name given to framestore 111 to 
make distinguishing between framestores easier for users, HADDR stands 
for Hardware Address, which is the Ethernet address of processing system 
101 which controls the framestore, and the ID, fifty-six, is the framestore 
identification reference (framestore ID). As shown in Figure 4, any frame 
stored within framestore 111 has a frame ID which contains the framestore 
ID, fifty-six. Thus when a user specifies a frame which he requires, the 
framestore on which it is stored is immediately known by identifying the 
framestore ID. 

[0067] Lines 611 and 612 give information about the interfaces of 
processing system 101. As shown in Figure 1, in this embodiment all the 
processing systems are connected to the Ethernet 151 and processing 
systems 101, 102 and 103 are also connected by a HiPPI network 152. In 
other embodiments (not shown) there may be various different networks 
using different protocols to which some processing systems are connected 
and others are not. Interfaces for every network to which a processing 
system is connected would be listed in that processing system's local 
configuration file. In Figure 6, line 611 describes the HiPPI interface of 
processing system 101 and line 612 describes the Ethernet interface. The 
interfaces are always listed in a certain order, the interface to the fastest 
network first and that to the slowest network last, thus ensuring that the first 
interface listed communicates with a preferred network. Hence in this 
example HiPPI is listed first. 



25 
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[0068] PROT stands for the protocol used to communicate through an 
interface, so in this example 'HIPPr means that the HiPPi protocol is used for 
the HiPPI network and TCP 1 means that TCP/IP is used over the Ethernet. 
IADDR gives the address of the respective interfaces. 

5 

[0069] The Ethernet address hence occurs twice in the local 
configuration file, once as the hardware address on line 601 and once as an 
interface address on line 603. This is because the FRAMESTORES and 
INTERFACES parts of the network configuration file 343 are used for 
10 different procedures and the local configuration data 341 must use the same 
structure as file 343 for ease of collating information. 

Figure 7 

[0070] When processing system 101 is switched on a thread reads local 
15 configuration data 341 into memory 322 as file 342 as shown in Figure 6, and 
also creates network configuration file 343 containing information about all 
other online users within the network. Figure 7 shows an example of a 
network configuration file stored in the memory of processing system 101, 
which contains information for the eight processing systems 101 to 108. The 
20 network configuration files in the memory of processing systems 102 to 108 
are similar to this, but contain slightly different information. 

[0071] The first framestore, at line 701, is Brazil, which Figure 7 showed 
as framestore 111 connected to processing system 101. Line 702 gives j 
25 information about framestore Scotland which has ID seventy-four. For 
example, this may be framestore 118. The network configuration file 343 

i 
i 
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cannot tell a user which processing system currently controls framestore 118, 
but an address of that processing system is given which is all that is 
necessary to contact it. 

5 [0072] Line 703 gives information about framestore Finland, which has 
ID seventy-two, and its controlling processing system. For example, this may 
be framestore 113. 

[0073] Lines 711 and 712 give the interface information for processing 
system 101, listed under 'Brazil' because that is the framestore which it 
currently controls, as in Figure 6. Line 713 gives interface information for the 
processing system controlling 'Scotland 1 and line 714 gives interface 
information for the processing system controlling 'Finland'. 

15 [0074] Only one interface is described for each online processing 
system (except the processing system on which the configuration file resides, 
in this case 101). The interface given is the one for the fastest system which 
both processing system 101 and the processing system controlling the 
respective framestore support. The interface given at line 714 is an Ethernet 

20 address, implying that the system controlling framestore 'Finland' is not 
connected to the HiPPI network. The interface given at line 713, however, is 
a HiPPI address, so the system controlling 'Scotland* is connected to the 
HiPPI network and hence communications between this processing system 
and system 101 can take place over this network rather than the slower 

25 Ethernet. 
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[0075] At present, a network configuration file such as 343 would have 
to be manually updated whenever a change occurs. The present invention 
ensures that file 343 is updated automatically whenever a processing system 
comes online, is switched off, crashes or exchanges framestores, thus 
5 guaranteeing that whenever access is needed to a framestore the correct 
processing system is asked for access. 

[0076] In this embodiment, the invention is performed by two threads 
running on each of processing systems 101 to 108. Figures 8 and 9 illustrate 
10 the functions of these. 

Figure 8 

[0077] Figure 8 shows processing systems 101, 102 and 103. The two 
threads which embody the invention run on all processing systems but the 
15 example in this Figure shows only three processing systems. Primary threads 
801, 802 and 803 on processing systems 101, 102 and 103 respectively are 
all identical. 

[0078] Processing systems 102 and 103 are already online and 
20 respectively contain in their memory files 842 and 852, containing their local 
configurations, similar to file 342 shown in Figure 6, and network 
configuration files 843 and 853, similar to network configuration file 343 
shown in Figure 7. Each also has local configuration data on their hard drive 
which is not shown. Processing system 102 is connected to framestore 112, 
25 as shown by connection 812, and processing system 103 is connected to 
framestore 113, as shown by connection 813. Processing system 101 is off- 
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line and therefore framestore 111 is unavailable for access, but processing 
system 101 and framestore 111 are connected within fibre channel switch 
121 as shown by connection 811. 

5 [0079] When processing system 101 is switched on, local configuration 
data 341 stored on the hard drive is read into memory as file 342 as shown 
by path 825, and then copied to become the basis for network configuration 
file 343 as shown by path 826. Primary thread 801 on processing system 101 
reads file 342 and announces it on the Ethernet network. 

10 

[0080] This announcement is caught by primary threads 802 and 803 on 
processing systems 102 and 103 respectively, as shown by paths 821 and 
822. Primary thread 802 reads file 842 and sends it to processing system 
101, as shown by path 823, and then adds the information contained in the 
15 announcement to its network configuration file 843. Similarly, primary thread 
803 sends file 852 as shown by path 824, and adds the information 
contained in the announcement to its network configuration file 853. 

[0081] Primary thread 801 on processing system 101 catches these 
20 messages and adds the information contained in them to its network 
configuration file 343. 

[0082] Hence processing systems 102 and 103, which were already 
online, are aware of processing system 101 coming online, and are also 
25 aware of its network addresses and which framestore it controls. In addition, 
processing system 101 knows that systems 102 and 103 are online, knows 
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their network addresses and which framestores they control. 
Figure 9 

[0083] Figure 9 illustrates the second thread which runs when a 
5 framestore swap occurs. As shown in Figure 8, processing systems 101 to 
103 are connected within the framestore switch to framestores 111 to 113 
respectively as shown by connections 811 to 813 respectively. A framestore 
swap occurs such that processing system 101 now controls framestore 112, 
as shown by connection 814, and processing system 102 is now connected 
10 to framestore 111 as shown by connection 815. 

[0084] A second thread, shown as maintenance thread 901 on 
processing system 101 and maintenance thread 902 on processing system 
102, receives a message from the swap utility 911 which informs it of its new 

15 framestore. In this example the swap utility 911 has been carried out on 
processing system 101, but it can run on any of processing systems 101 to 
108, regardless of which systems are actually involved in the swap. In this 
case swap process 911 announces the swap to processing system 102, as 
shown by path 921, and effectively announces it to its own processing 

20 system 101 as shown by path 922. Maintenance threads 901 and 902 update 
their respective local configuration data 341 and 841, reread them into 
memory as files 342 and 842, as shown by paths 923 and 924, and change 
their respective network configuration files 343 and 853. 

25 [0085] Maintenance threads 901 and 902 then announce their new 
configurations on the Ethernet. Primary threads 802 and 803 catch the 
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announcement by thread 901, as shown by paths 925 and 926 respectively, 
and threads 801 and 803 catch the announcement by thread 902, as shown 
by paths 927 and 928 respectively. Primary threads 801, 802 and 803 then 
update their respective network configuration files 343, 843 and 853. Hence 
5 each processing system is now aware that the swap has taken place, and 
each local and network configuration file is correct. 

[0086] Both the primary and maintenance threads have other duties 
which will be enlarged upon later. 

10 

Figure 10 

[0087] Figure 10 shows the basic process of primary thread 801 on 
processing system 101. Threads 802 and 803 on processing systems 102 
and 103 are identical to 801, as are threads on each of processing systems 
15 104 to 108. The thread starts when the processor is switched on and at step 
1001 a start up process is performed which writes network configuration file 
343. 

[0088] At step 1002 various functions are performed which keep the 
20 network configuration file accurate if the network structure changes, and at 
step 1003 the thread terminates when the processor is switched off. 

Figure 1 1 

[0089] Figure 11 details step 1001, the process which occurs when 
25 processing system 102 is switched on. At step 1101 local configuration data 
341 is read into memory 322 as local configuration file 342 and at step 1102 
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the information contained in file 342, together with a message notifying that 
the processing system sending the message is online, is multicast on the 
network. A multicast is a message sent to all users on the network whose 
Ethernet address starts with a certain sequence of digits, so when this 
5 network was set up it would be configured so that all processing systems 
connected to a particular fibre channel switch have an address starting in the 
same way. Hence a processing system can easily be added to the network 
since as long as its address starts in a particular way it will receive the 
multicasts. 

10 

[0090] In this embodiment processing systems 101 to 108 are the only 
systems in the network, but in an alternative embodiment (not shown) there is 
a large network of processing systems within which there is a number of 'sub- 
networks', each arranged around one of several fibre channel switches. 

I 

15 Within each of these sub-networks all the processing systems have Ethernet ! 
addresses which start in the same way and differently from any system on a 
different sub-network. Setting up a network in this way and using multicasts 
ensures that processing systems only receive information which is relevant to 
them. It also means that, if necessary, a processing system can be moved 

20 between sub-networks simply by changing its Ethernet address. 

[0091] At step 1103 responses are received from all processing systems 
within the network which received the multicast and which are switched on. 
These responses are in the form of unicasts, which are messages sent only 
25 to one processing system. Each of these unicasts comprises the information 

i 

contained in the local configuration file in the memory of the processing 

j 

i 
j 
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system which sent it. Hence each processing system which is connected to 
the fibre channel switch and which is online has sent its local configuration 
information to processing system 102. 

5 [0092] At step 1104 file 342 is copied to become the basis for network 
configuration file 343 and at step 1105 the question is asked ( as to whether 
any responses were received at step 1103. If no other processing systems 
are switched on then no unicasts will have been received in response. This is 
unlikely, as processing system 101 must be online in order for the fibre 
10 channel switch to be operated and, as observed before, in most 
environments all of the processing systems would remain operational unless 
taken off-line for a specific reason, but it is possible, so if the question asked 
at step 1105 is answered in the negative then step 1001 is completed since 
there is no information to add to network configuration file 343. 

15 

[0093] If the question asked at step 1105 is answered in the affirmative, 
then at step 1106 the information contained in the first received unicast is 
added to file 343. At step 1107 the question is asked as to whether another 
unicast has been received. If this question is answered in the affirmative then 
20 control is returned to step 1106 and the next unicast is added to file 343. 
Eventually, all responses will have been processed and the question asked 
at step 1107 will be answered in the negative. At this point, network 
configuration file 343 is complete and gives an accurate picture of the 
network. 



25 
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[0094] As shown in Figure 7, all available framestores are listed first 
under FRAMESTORES, together with the Ethernet addresses of the 
processing systems to which they are connected and their IDs. Each 
framestore is listed again under INTERFACES together with the preferred 
5 interface information of the processing system to which it is connected. If a 
processing system is not online then the framestore which it controls is not 
available, so no reply will have been received from that processing system 
and its framestore will not be listed in the network configuration file. 

10 [0095] If no unicasts were received at step 1103 then network 
configuration file 343 will include only the information within the local 
configuration file 342. 

[0096] When a user of a processing system specifies frames to which 
15 he requires access the application he is using looks at the framestore ID 
contained within the frame IDs. It searches for that framestore ID in the 
INTERFACES section of network configuration file 343, and so checks 
whether the framestore is available for access, and then determines the 
address to which the requests for access should be sent. 

20 

[0097] The information listed under FRAMESTORES is used when a 
swap of framestores takes place. When this occurs the location data given in 
Figure 4 must also be swapped between the processing systems and in this 
case the Ethernet must be used, and so it is only the Ethernet addresses 
25 which are listed in this section. 
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Figure 12 

[0098] Figure 12 details step 1106 which adds information contained in 
a message (a unicast or multicast) to network configuration file 343. These 
messages contain the local configuration file of the sender, similar to that 
5 shown in Figure 6. At step 1201 the INTERFACES information contained in 
the message is read to identify the first listed protocol. As previously stated, 
the interfaces are listed by the speed and hence desirability of the networks 
to which they connect. Hence if the first protocol listed in the message 
O matches a protocol listed in file 342, this is the interface which will be used for 

yi 10 communication. If the first protocol does not match then the second is 
checked and so on. There will always be a protocol which matches because 
s| all processing systems are connected by the Ethernet. 

m 

O [0099] Hence at step 1202 the question is asked as to whether the 

O is identified protocol is listed in file 342. If this question is answered in the 

negative then control is returned to step 1201 and the next protocol is 

identified. 

[0100] If the question is answered in the affirmative then at step 1203 
20 the question is asked as to whether the addresses for that protocol 'match', ie 
whether they start in a similar way. A protocol may be used for more than one 
network and hence when a matching protocol is found it must be checked 
that the networks also match. Hence if the addresses do not start in the same 
way they are addresses for different networks using the same protocol, and 
25 so if the question is answered in the negative then control is returned to step 
1201 and the next protocol is identified. 



2034-P561-US 



28 

1201 and the next protocol is identified. 

[0101] If the question asked at step 1203 is answered in the affirmative 
then the fastest network which both processing systems support has been 
5 found. Thus at step 1204 the message is once more read and the information 
under FRAMESTORES and the single line of information under 
INTERFACES which refers to the last checked protocol are written to network 
configuration file 343. The message has now been added to the network 
configuration file. 

10 

Figure 13 

[0102] The functions performed at step 1002 are detailed in Figure 13. 

[0103] Function 1301 adds information to network configuration file 343 
15 when another processing system joins the network or changes its local 
configuration data in any way. 

[0104] Function 1302 deletes information from the network configuration 
file 343 when a processing system shuts down or swaps framestores. 

20 

[0105] Function 1303 responds to communications checks to confirm 
processing system 101 is still online. Maintenance thread 901 sends out 
similar communications checks as shown in Figure 21. 

25 [0106] Function 1304 provides applications running on processing 
system 102 with accurate information about which framestores are 
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connected to which processing systems. 
Figure 14 

[0107] Function 1301 is detailed in Figure 14. At step 1401 a multicast is 
5 received from a processing system, say processing system 103, which has 
just been switched on. This is in the same form as the multicast sent by 
processing system 102 at step 1102. It contains the local configuration 
information of processing system 103 together with a message that the 
system sending the multicast is online. 

10 

[0108] At step 1402 the Ethernet address of the transmitting system is 
read from the FRAMESTORES section of the multicast and at step 1403 the 
information contained in file 342 in the memory 402 of processing system 
102 is unicast back to processing system 103. 

15 

[0109] At step 1404 any entries which conflict with the information just 
received are removed from network configuration file 343. There will not be 
conflicting information if the multicast has been sent by a processing system 
just coming online, but there will be when a framestore swap occurs. In this 
20 case there will already be entries for each framestore but the interfaces will 
be wrong. 

[0110] At step 1404 the information contained in the multicast is added 
to network configuration file 343, in exactly the same way that information 
25 contained in responding unicasts received at step 1103 was added to the 
network configuration file at step 1104, as detailed in Figure 12. 
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[0111] Thus the network configuration file on each processing system is 
updated whenever any other processing system within the network is 
switched on or multicasts out changed details. 

5 Figure 15 

[0112] Figure 15 details step 1404 at which entries which conflict with 
the received information are deleted. At step 1501 the message is read and 
the framestore ID contained within it is identified. 

10 [0113] At step 1502 the question is asked as to whether this ID is 
contained within network configuration file 343, If this question is answered in 
the affirmative then at step 1503 the entries under FRAMESTORES and 
under INTERFACES corresponding to this ID are removed. 

15 [0114] At this point, and if the question asked at step 1502 is answered 
in the negative, control is directed to step 1504 at which point the Ethernet 
address contained in the multicast is identified. At step 1505 the question is 
asked as to whether this address is contained within network configuration 
file 343. It is necessary for this question to be asked even if the framestore ID 

20 was not contained in the network configuration file, since it is possible for an 
Ethernet address to already be in a network configuration file but not the ID, 
or vice versa, as a new processing system or framestore could have been 
connected to an existing framestore or processing system. 

25 
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[0115] If the question asked at step 1505 is answered in the affirmative 
then the entries under FRAMESTORES and under INTERFACES which 
correspond to the Ethernet address should be deleted. However, since it may 
not be the Ethernet address but a different one which appears in the 
5 INTERFACES section, the framestore ID linked with the Ethernet address is 
identified at step 1506 by examining the FRAMESTORES section of network 
configuration file 343. At step 1507 the information corresponding to that ID in 
both sections is deleted. 

10 Figure 16 

[0116] Figure 16 details function 1302 which deletes information from 
the network configuration file when a processing system shuts down or 
swaps framestores. At step 1601 a multicast is received containing 
information that a particular processing system, say system 104, is offline. 
15 This is in the same form as a multicast sent when a system switches on in 
that it contains the local configuration file of processing system 104, except 
that the extra message contained indicates that the system sending the 
multicast is offline rather than online. No unicast is sent in response to this 
multicast. 

20 

[0117] At step 1602 the Ethernet address of the transmitting system, in 
this case processing system 104, is read from the FRAMESTORES section 
of the multicast. 

25 [0118] At step 1603 the process examines the FRAMESTORES part of 
network configuration file 343 on processing system 101 and identifies the 
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framestore which is linked with the address of processing system 104, 
identified at step 1602. At step 1604 the information about this framestore 
under FRAMESTORES and under INTERFACES is deleted from the file. 
Thus the network configuration file on each processing system is updated 
5 whenever any other processing system shuts down. 

Figure 17 

[0119] Figure 17 details process 1303 which responds to a 
communications check. At step 1701 a communications check unicast is 

10 received, say from processing system 105, which contains only the Ethernet 
address of the sending processing system. This is a check by system 105 to 
ensure that processing system 101 is still online and has not crashed. At step 
1702 a replying unicast is sent to processing system 105. Checks of this kind 
are sent out from processing system 101 by maintenance thread 901, as 

15 shown in Figure 21. 

Figure 18 

[0120] Figure 18 details function 1304 which supplies information to 
applications running on processing system 101. At step 1801 a request for 
20 information is received in the form of a time and date. This is the modification 
date of the file which the application currently holds. (If an application has not 
requested information before, the date sent will be midnight at 01 January 
2000.) 

25 [0121] At step 1802 the question is asked as to whether this time and 
date is the same as the modification time and date of network configuration 
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file 343. If this question is answered in the negative then the network 
configuration file has been updated since the last time the information was 
sent to the application, and so at step 1803 the information contained under 
INTERFACES within network configuration file 343 is sent to the application. 

5 

[0122] If the question asked at step 1802 is answered in the affirmative 
then no updates have taken place and the information the application has is 
still correct In this case, control is directed to step 1804 at which a message 
'NO UPDATE' is sent to the application. 

10 

[0123] In this way, applications are supplied with up-to-date information 
when they need it. The information is required when a user wishes to access 
information stored on a framestore to which he is not connected. When a 
processing system requests access to another framestore this request may 
15 be sent by the fastest route possible, which is why it is the interface to the 
fastest network which is listed under INTERFACES and sent to the 
applications. 

Figure 19 

20 [0124] Figure 19 details step 1003, the termination of primary thread 
801. This only occurs when processing system 101 is shut down for any 
reason, so at step 1901 the thread receives notice that the processor is going 
to shut down. 

25 [0125] At step 1902 a multicast is sent out containing the file 342 stored 
in the memory 342 of processing system 101, together with a message that 
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the system is going offline, similar to that received from processing system 
104 at step 1601, so that all other processing systems can remove the 
framestore controlled by processor 101 from their respective network 
configuration files. No responses are received to this multicast. 

5 

[0126] At step 1903 thread 801 terminates. Since the network 
configuration file 343 is stored in memory 322 it is lost when the processor 
switches off, similarly for file 342. Hence there is no old information to conflict 
with the correct network configuration when the processor next starts up and 
10 loads the local configuration data 341 from the hard drive 327. 

Figure 20 

[0127] Figure 20 shows the functions of maintenance thread 901. This 
thread runs on each of processing systems 101 to 108 but in this example 
15 runs on processing system 101 . 

[0128] Function 2001 is the sending out of communications checks to 
ensure that other processing systems are still online. 

20 [0129] Function 2002 rewrites the local and network configurations 341 
and 343 whenever a framestore swap occurs between processing system 
101 and any other system. 

[0130] Function 2003 rewrites network configuration file 343 if for any 
25 reason local configuration data 341 is manually changed. 
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Figure 21 

[0131] Figure 21 details process 2001 at which communication checks 
are sent out. At step 2101 the FRAMESTORES part of network configuration 
file 343 is read to identify the Ethernet addresses of all online processing 
5 systems. The first address is ignored as this is the address of processing 
system 101 itself. 

[0132] At step 2102 the question is asked as to whether the network 
configuration file contains any addresses, apart from the address of system 
10 101. If this question is answered in the negative then no communications 
check is necessary since no other processing systems are online, and so 
control is directed to step 2109, whereby the process waits for a specified 
length of time, which in this example is five minutes, before trying again. 

15 [0133] If the question asked at step 2102 is answered in the affirmative 
then at step 2103 communications checks are sent to all addresses which 
have not been 'seen', i.e. with which there has been no communication in the 
last five minutes. If there has been communication then a communication 
check is unnecessary, if all systems have been 'seen 1 then no unicasts will 

20 be sent, so at step 2104 the question is asked as to whether any 
communications checks were made. If this question is answered in the 
negative then control is directed to step 2109 at which the process waits for 
five minutes before returning to step 2101 . 

25 [0134] If the question asked at step 2104 is answered in the affirmative 
then at step 2105 responses are received from the checked addresses. 
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[0135] At step 2106 the question is asked as to whether replies were 
received from all the addresses to which checks were sent. If this question is 
answered in the affirmative then control is directed to step 21 09 where the 

5 process waits for five minutes, if the question is answered in the negative 
then at step 2107 the process examines the FRAMESTORES part of the 
network configuration file to identify the framestores linked with the 
addresses which did not respond. The information corresponding to these 
framestores under FRAMESTORES and under INTERFACES is deleted 

10 from the network configuration file at step 21 08. 

[0136] At step 2109 the process waits. After waiting for five minutes 
control is returned to step 2101 and the process starts again. 

15 Figure 22 

[0137] Figure 22 details step 2103 whereby communications checks are 
sent out. Every time a multicast or unicast is received from a processing 
system this is logged so that unnecessary checks are not sent to systems 
which have recently communicated. Regardless of which network is used for 
20 the message, it is the corresponding Ethernet address which is logged. 
Hence at step 2201 the question is asked as to whether the first Ethernet 
address identified at step 2101 has been 'seen', i.e. logged, since the last 
communications check. 

25 [0138] If this question is answered in the negative then at step 2202 a 
communications check is sent to that address. The check takes the form of a 
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unicast which only contains the Ethernet address of the sender, similar to that 
received at step 1701. This prompts the receiving processing system to send 
a unicast in reply containing its Ethernet address, similar to that sent at step 
1702. 

5 

[0139] If the question asked at step 2201 is answered in the affirmative, 
ie the address has been 'seen' recently, then control is directed to step 2203 
at which the question is asked as to whether there is another address to 
check. If this question is answered in the affirmative then control is returned 
10 to step 2201 and the next address is checked. If it is answered in the 
negative then all necessary communications checks have been sent. 

[0140] The communications check ensures that if a processor crashes 
then every processing system in the network is made aware that a particular 
15 processing system is no longer contactable. If a processor crashes then the 
framestore which it controls is not available for access, so it should be 
removed from the network configuration file. 

Figure 23 

20 [0141] Figure 23 details function 2002, the rewriting of the configuration 
files when a framestore swap occurs. 

[0142] At step 2301 a unicast is received from swap utility 911, which 
could be running on any processing system but in this example is running on 
25 processing system 101. This contains the name and ID of the framestore 
which processing system 101 now controls. A similar unicast is sent to the 
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other processing system taking part in the swap, in this example processing 
system 102. 

[0143] At step 2302 a message is sent to a request daemon running on 
5 processing system 101 which catches requests for remote access to the 
framestore which system 101 controls. This message instructs the daemon to 
turn away all requests until further notice. This is because until the network 
configuration files on processing systems 102 to 108 are updated they will be 
sending requests for access to framestore 111 to processing system 101, but 
10 framestore 111 is now controlled by processing system 102 and so the 
requests cannot be honoured. 

[0144] At step 2303 local configuration data 341 is rewritten by replacing 
the framestore name and ID contained within it with the new name and ID 
15 received from swap utility 911. At step 2304 data 341 is reread into memory 
as local configuration file 342 replacing the existing file. 

[0145] At step 2305 the network configuration file is rewritten and at step 
2306 local configuration file 342 is multicast onto the Ethernet so that all 
20 other processing systems know of the change. 

[0146] At step 2307 the request daemon is instructed to allow requests 
for access since processing systems 102 to 108 will now be sending 
requests to the correct processing system. 

25 
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Figure 24 

[0147] Figure 24 details step 2305 at which network configuration file 
343 is rewritten. At step 2401 the information about the first listed framestore 
is deleted, under both FRAMESTORES and INTERFACES. This is always 
5 the information about the framestore which processing system 101 controls 
and it has now changed. 

[0148] At step 2402 the framestore ID of the framestore which 
processing system 101 now controls is identified from local configuration file 
10 342 and at step 2403 the entries under FRAMESTORES and INTERFACES 
corresponding to that ID are deleted. The information about this ID relates to 
the processing system with which processing system 101 has swapped and 
is now incorrect. 

15 [0149] At step 2404 the information contained in local configuration file 
342 is copied in and network configuration file 343 is now up-to-date and may 
be multicast at step 2306. 

Figure 25 

20 [0150] Figure 25 illustrates function 2003. This runs when a user 
updates local configuration data 341, for instance because interface 
information has changed. 

[0151] At step 2501 thread 901 receives notice that the local 
25 configuration has changed. This is a message triggered by the saving of the 
local configuration data. At step 2502 the local configuration data is reread 
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into memory as file 342. 

[0152] At step 2503 the information about the first listed framestore, ie 
that controlled by processing system 101, is deleted from network 
5 configuration file 343, as at step 2401, and at step 2504 the information from 
local configuration file 342 is read in. 

[0153] At step 2505 the network configuration file is multicasted out on 
the Ethernet so that all other processing systems know of the change. 

10 



